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In this lecture, we introduce the complementary slackness conditions and use them to obtain 
a primal-dual method for solving linear programming. 

1 Complementary Slackness 

As we have seen before, using strong duality, we know that the optimum value for the 
following two linear programming are equal, i.e. u = w, if they are both feasible. 



Using the above result, we can check the optimality of a primal and/or a dual solution. 

Theorem 1. Suppose x and y are feasible solutions to (P) and (D). Then x and y are 
optimal if and only if the following conditions are satisfied: 



Proof. First, we note that since x and y are feasible (bi — ^ • aijXj)yi > and (HjUi — 



u = max{c T x : Ax < b, x > 0} (P) 
w = min{b T y : A T y > c, y > 0} (D) 





Cj)xj > 0. By summing over i and j, we have: 




(1) 




(2) 



By adding 1 and 2 and using the strong duality theorem 



O'ij %j Ui ~l" ^ ^ Q>ij Hi %j 



Yl c i x -j = Yl biyi - Yl c o x o = °- 
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Therefore, all our inequalities must be equalities and we obtain the desired result. 
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2 Primal-dual algorithm 



The main implication of Theorem 1 is that if x and y are feasible and satisfy the comple- 
mentary slackness conditions, then they are optimal. This result leads us to the primal-dual 
algorithm in which we start with a feasible solution x and y and try to satisfy the conditions 
more and more. 

For the sake of convenience, we consider the primal and dual programs as follows: 

min{c T x : Ax = b, x > 0} (P) 

max{b T y : A T y < c} (D) 

In this form, the complementary slackness conditions that we need to satisfy are reduced 
to: 

V -? ( c i ~ J2 a ijVi) x j = °- ( 3 ) 

i 

The steps of the primal-dual algorithm are as follows: 

1. Start with a feasible solution y for (D). Obtaining such feasible solution y is easier 
than solving the linear program in many cases. 

Let J = {j : J2i a ijVi = c j}- 

Now using 3, we need to obtain a solution x for (P) such that Vj J, Xj = 0. So the 
question is whether there is a feasible solution x with this property. 

2. Formulate the restricted primal (RP) as follows: 

m 

min Xi 
i=i 

V« ^ ciijXj + Xi = bi 
Xi, xj > 

In fact, (RP) formulates the problem of finding feasible solution x with the afore- 
mentioned property. Here variables X^s are artificial variables and if min YliLi Xi is 
equal to zero, then Xj's are optimal solutions to (P). 
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3. If Opt(RP) = then x and y are optimal. Otherwise Opt(RP) > and we write the 
dual of (RP), namely (DRP), for which we get solution y. 

m 

max y]bjyi 
i=l 

Vj G J ^2 aijyi < 

i 

Vi < i 



4. Improve the solution to (D) by setting y' = y + ey. Here we determine e such that 
y' is feasible and Yli^iVi > Yli^iVi- For feasibility, we must satisfy the condition 

v i Yji a ijy'i < c i- For J ^ -A we must nave Y,i a ijUi + e Y^i a ijVi ^ c r Since V? G 
^ Yli a ijVi < 0, e can be arbitrary positive for j £ J. 

Thus by taking 

Cj — X^i a ijUi 

e - min WJ s . t . E . ai ^.> } v — 

we obtain our e > such that y' is feasible. 
Also since Opt(DRP) = Opt(RP) > and e > 0, 



it i i 

We note that in the above primal-dual algorithm, solving (DRP) is usually easier than 
solving (P) or (D). In fact, in this approach, programs (P) and (RP) are temporary 
programs and we want to solve (D). To this end, we first solve (DRP) and then use the 
solution to improve y iteratively. 



2.1 Example 

Consider the following formulation of the max-flow problem: 
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max f 

x sj ~ Yl x i s ~ f — ® 

j j 

3 3 

Vi 7^ S,t x ij ~ Y2 X ^ — ® 

j j 

%ij — Uij 
—Xij < 

It is worth mentioning that in the original max-flow formulation, the first three sets of 
constraints are equalities. However in our new formulation by summing these three sets of 
inequalities, we get < and thus these weaker sets of inequalities imply the equalities. 

Now, we consider the above formulation as (D). One feasible solution to (D) can be obtained 
by taking x as a zero vector. Now if we go directly to (DRP) we have: 

maxf 

2 Xs 3 ~ 2 x i s ~ f - 

j j 

f ~ Y x it + x « - 

3 3 

Vi / s, t ^2 x ij ~ Yj Xji — ® 

j j 
Xij < Vi, j where x^ = in (D) 

—Xij < Vi, j where Xij = in (D) 

/<1 

We can observe that (DRP) has the following interpretation. Find a path from s to £ (with 
a flow of value 1) that uses only the following arcs in the following ways: saturated arcs in 
the backward direction; arcs with zero flow in the forward direction; and other arcs in either 
direction. In other words, we need to find a path in the residual graph. This observation 
shows that the max-flow algorithm is in fact a primal-dual algorithm. 
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Finally, we note that primal-dual algorithms do not have polynomial running time guaran- 
tees. 
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